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Can Technology Help 
Promote Equality of 
Educational Opportunities? 

BRIAN JACOB, DAN BERGER, CASSANDRA HART, 
AND SUSANNA LOEB 


This chapter assesses the potential for several prominent technological innovations to promote equality of 
educational opportunities. We review the history of technological innovations in education and describe 
several prominent innovations, including intelligent tutoring, blended learning, and virtual schooling. 
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The 1966 release of the Coleman Report (Cole¬ 
man et al. 1966) is widely recognized as a piv¬ 
otal moment in the history of education in the 
United States. The report documented vast in¬ 
equities in academic achievement between 
white and nonwhite children. Coleman and his 
colleagues found a great deal of racial segrega¬ 
tion across schools along with important dif¬ 
ferences in the family resources (including fac¬ 
tors such as parental education and household 
composition) available to white and nonwhite 
children. On the other hand, they uncovered 
substantially fewer differences in school re¬ 
sources (for example, pupil-teacher ratio and 
school facilities) by race. The analysis con¬ 
ducted by the researchers suggested that the 
variation in student performance was driven 
primarily by socioeconomic conditions in fam¬ 
ilies and neighborhoods. Schools—and thus 


any differential resources across schools—ex¬ 
plained relatively little of the achievement dif¬ 
ferences. 

The report spurred new research and policy 
action aimed at improving school productivity 
and attempting to close the achievement gap. 
Although there has been progress on some 
fronts, many of the key findings of the Cole¬ 
man Report remain true today, as is high¬ 
lighted in other papers in this issue. Schools 
made rapid progress toward racial desegrega¬ 
tion in the 1960s and 1970s, but that progress 
has either stalled or reversed since the 1980s, 
depending on how segregation is measured 
(Reardon and Owens 2014). While achievement 
gaps have narrowed, African American and La¬ 
tino children still score roughly 13 percent 
lower than their Caucasian and Asian peers on 
standardized exams. 1 In an effort to overcome 
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continued inequalities, policies have cycled in 
and out of favor, much like a pendulum swing¬ 
ing. The emphasis on test-based accountability 
(for example, high school exit exams) in the 
early 1970s reappeared several decades later in 
the federal accountability policy No Child Left 
Behind, enacted in 2002. The focus on rigorous 
standards in the 1980s (such as the push for 
states to require high school students to com¬ 
plete at least three years of math and science) 
is reminiscent of the current focus in the Com¬ 
mon Core. And today’s push to explore new 
educational technologies recalls earlier efforts 
to introduce computers into schools (Chris¬ 
tensen, Johnson, and Horn 2010). 

New technologies are not new. Blackboards 
were new before they were replaced by white¬ 
boards. Slates were new, then replaced by pa¬ 
per and now, to some extent, computers and 
tablets. Filmstrips were new, and then replaced 
by DVDs and now web-accessed videos. In each 
case, the new technology brought both costs 
and benefits. Often it brought little change in 
teaching or learning. In his influential book 
Oversold and Underused: Computers in the Class¬ 
room, Larry Cuban (2003) argues that teachers 
and students use computers in schools far less 
frequently than commonly assumed and that 
the presence of computers has not changed the 
traditional instructional paradigm of whole- 
class, teacher-centered instruction. When teach¬ 
ers use computers, it is primarily for mundane 
tasks. Students write essays using word proces¬ 
sors, practice math problems using simplistic 
software, or use the Internet to do web-based 
research. Teachers use computers to record 
grades, prepare lessons, and read email (Cu¬ 
ban 2003; Gray et al. 2010). 

However, recent technological innovations 
have expanded the capabilities of digital learn¬ 
ing tools in ways that boosters argue offer new 
potential to “disrupt” the provision of educa¬ 
tion and reduce disparities in educational op¬ 


portunities (Christensen, Johnson, and Horn 
2010). First, the increasing speed and availabil¬ 
ity of Internet access can reduce many of the 
geographic constraints that have disadvan¬ 
taged poor students. Students can now access 
online videos that provide instruction on a 
wide variety of topics at various skill levels and 
participate in real-time video conferences with 
teachers or tutors located a state (or even a 
continent) away. 2 This technology has even 
expanded opportunities for the long-distance 
professional development of teachers, enabling 
novice teachers to receive mentorship from 
master teachers regardless of distance (Dede 
2006). 

Second, these technologies scale easily so 
that innovations (or even good curriculum) can 
reach more students. Much like a well-written 
textbook, a well-designed educational software 
application or online lesson can reach stu¬ 
dents not just in a single classroom or school 
but across the state or country. 

Third, advances in artificial intelligence 
technology now allow teachers to differentiate 
instruction, providing extra support and devel- 
opmentally appropriate material to students 
whose knowledge and skill is far below grade- 
level norms. The latest “intelligent” tutoring 
systems are able to not only assess a student’s 
current weaknesses but also diagnose why the 
student is making the specific errors (Graesser, 
Conley, and Olney 2012). Related to this devel¬ 
opment, the explosion of “big data,” in theory, 
can allow researchers and program developers 
to utilize the experience of thousands or even 
millions of learners to determine more effec¬ 
tive instructional approaches—again tailored 
for students with very particular needs. 3 

Although technologies such as virtual in¬ 
struction and the suite of programs known 
collectively as intelligent tutoring offer great 
promise, they are not guaranteed to improve 
educational equality. Use of these technologies 


2. Similarly, the Internet has enhanced the ability of non-experts, including classroom teachers, to create and 
upload their own videos. 

3. The evolution of touch-screen technology on smart phones and tablets has enabled very young children to 
engage in technology-aided instruction. Prior to tablets, it was difficult for preschool, kindergarten, and even 
early primary grade students to work with educational software, which required the use of a mouse or keyboard. 
Now there are hundreds of applications that expose children to early literacy and numeracy skills without the 
need to manipulate a keyboard or mouse. 
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often reduces oversight of students, and that 
can be particularly detrimental for children 
who are less motivated or who receive less struc¬ 
tured educational supports at home. These 
technologies may also be less effective in en¬ 
gaging reluctant learners in the way a dynamic 
and charismatic teacher can, suggesting that 
even if educational technology improves qual¬ 
ity overall, any “peak” education experience it 
provides may fall short of a “peak” face-to-face 
experience. Perhaps more importantly, tech¬ 
nologies such as intelligent tutoring and sys¬ 
tems that blend online and face-to-face (FtF) 
instruction are notoriously difficult to imple¬ 
ment well. There is a substantial risk that they 
could be ineffective or even harmful in places 
that lack the capacity to implement the tech¬ 
nologies with fidelity. 

In this paper, we assess the potential for 
these “next generation” technologies to pro¬ 
mote equality of educational opportunities. To 
begin, we focus on virtual instruction, which 
is arguably the most visible and controversial 
of the new technologies. Utilizing detailed ad¬ 
ministrative data from Florida, we describe 
which types of students are most likely to take 
virtual courses, and how students who take vir¬ 
tual courses fare in comparison with their 
peers taking FtF courses. We then discuss the 
theory behind and evidence for intelligent tu¬ 
toring systems. In the final section, we discuss 
the implications of the findings reported here 
for education policy in the future. 

VIRTUAL INSTRUCTION 

One of the most visible examples of technology- 
aided learning involves virtual course-taking. 
An estimated 1.5 million K-12 students partic¬ 
ipated in some online learning in 2010 (Wicks 
2010), and online learning enrollments are pro¬ 
jected to grow in future years (Picciano et al. 
2012; Watson et al. 2012). 4 Although full-time 
virtual schools have grown in recent years, the 
vast majority of students participating in on¬ 
line instruction are part-time—that is, they 
are enrolled in a traditional brick-and-mortar 
school but take one or more classes online. 
Typically, these classes are asynchronous: stu¬ 


dents and teachers are not communicating 
with each other in real time through video con¬ 
ferencing technology. Students often take 
these courses outside of school (for example, 
at home or in a public library), although in re¬ 
cent years many schools have allowed students 
to take online courses at school during the day. 
Note that the online instruction we describe 
here is distinct from blended learning models, 
which combine online and FtF instruction (dis¬ 
cussed later). 

How Online Instruction Might Influence 
Student Outcomes 

Online classes can affect students’ outcomes 
either by affecting their access to courses, and 
thereby changing their choice of courses, or by 
affecting the quality of the educational envi¬ 
ronment they experience. Access to online 
courses may change the courses that students 
are able to take and thus their progress through 
school in terms of both their accumulation of 
credits and the types of classes they complete. 
Students may benefit from being able to take 
additional courses online during the school 
year or during the summer, either for catchup 
or for enrichment. With regard to enrichment, 
smaller and poorer high schools tend to have 
fewer Advanced Placement (AP) offerings, elec¬ 
tive courses, and foreign language courses com¬ 
pared to larger schools with better resources 
(Barker 1985; Pufahl and Rhodes 2011). As dis¬ 
cussed in other papers in this issue, this raises 
several concerns. First, the lack of advanced- 
level course availability has implications for 
students in low-income and minority schools 
when they transition to college (Schneider and 
Saw, this issue). Second, even when such courses 
are available, social boundaries may stymy 
nondominant groups’ participation in them 
(Carter, this issue). Access to virtual courses 
could help alleviate both of these concerns. 
With regard to the first concern, students who 
fail a course during one school year may opt to 
take that course online in lieu of attending 
summer school or repeating the course the fol¬ 
lowing school year (Cooper et al. 2000; Watson 
and Gemin 2008). Moreover, virtual schooling 


4. The International Association for K-12 Online Learning (iNACOL) defines online learning as teacher-led edu¬ 
cation that takes place over the Internet with teacher and student separated by geography. 


TECHNOLOGY AND EQUALITY OF EDUCATIONAL OPPORTUNITIES 


245 


can provide some consistency of course access 
for highly mobile populations or students who 
must spend time away from their traditional 
brick-and-mortar school because of health, in¬ 
carceration, or other personal situations. 

The best evidence on whether simply im¬ 
proving access to different courses through 
virtual schools affects students’ academic out¬ 
comes comes from a large-scale random as¬ 
signment study carried out in Maine and Ver¬ 
mont (Heppen et al. 2012). Sixty-eight schools 
that had not historically offered Algebra I to 
eighth-graders were randomly assigned to ei¬ 
ther a treatment group, which was given access 
to an online Algebra I course, or a control 
group, which did not receive access. Algebra- 
ready students in treated schools showed im¬ 
provements on test scores and took more ad¬ 
vanced courses in high school (Heppen et al. 
2012). Although these results are encouraging, 
this efficacy study took place under idealized 
conditions—selected students were particu¬ 
larly advanced, and virtual classes were held 
during the school day with an on-site proctor 
who, in 80 percent of the schools, was a math 
teacher. 

As described earlier, online instruction may 
also influence the quality of the educational 
environment in several ways. Individuals teach¬ 
ing online courses may be more or less ef¬ 
fective than their counterparts teaching FtF 
courses. One’s peers in an online course may 
be different than in a FtF course, and perhaps 
more importantly, it seems likely that peer ef¬ 
fects would be less pronounced in an online 
setting. Finally, it is likely that curricular and 
instructional approaches differ, given both 
the constraints and opportunities of online 
courses relative to those in traditional class¬ 
rooms. The online platform may allow for 
course characteristics that are simply not pos¬ 
sible in the FtF environment. For instance, stu¬ 
dents can work at their own pace (Anderson 
2008), and if they do not understand key con¬ 
cepts in lectures or become distracted, they 
can replay the lectures to bolster their under¬ 
standing. Moreover, the setup of online courses 
may allow the same material to be presented 
in multiple ways to best match a student’s 
learning style. 

The online platform may also provide op¬ 


portunities for planning, oversight, and uni¬ 
formity that are far more difficult in FtF class¬ 
rooms. Curriculum specialists can plan the 
course, including quite detailed scripts for 
teachers. Teachers can implement these spec¬ 
ified curricula, focusing their time and skills 
on responding to students’ questions and 
needs. For this reason, the quality of courses 
may be much more homogeneous in virtual 
settings than in brick-and-mortar classes, 
though course quality may depend on the qual¬ 
ity of the curriculum planning team. Insofar 
as we are concerned about the potential for the 
“teaching to the test” behaviors discussed by 
Jennifer Jennings and Douglas Lauen (this is¬ 
sue), this homogeneity of virtual courses 
makes them less likely to be impacted by local 
accountability pressures. On the other hand, 
FtF courses provide opportunities for interac¬ 
tion with peers and teachers that are not avail¬ 
able in the online environment. The proximity 
of teachers and students in FtF settings may 
also make it easier for teachers to monitor stu¬ 
dents’ work, keep them on task, or read facial 
clues to determine whether students are con¬ 
fused about course concepts (Anderson 2008). 
Classes in one environment may meet the 
same needs met in the other environment, but 
the process may be more difficult. 

The extent to which a student benefits from 
a virtual class is likely to depend on the char¬ 
acteristics of the individual student. For in¬ 
stance, the benefits of being able to repeat 
material at a slower pace might be more pro¬ 
nounced for low-achieving students. Non¬ 
native English speakers might benefit from on¬ 
line instruction that allows them to pause and 
look up unfamiliar words. For each of these 
groups, plausible stories could be told in the 
opposite direction as well. 

The utility of taking online courses is also 
likely to vary based on the counterfactual con¬ 
ditions that individual students would experi¬ 
ence in the absence of the virtual option. For 
instance, we might expect that even if there 
were no differences across sectors in average 
teacher (or peer) quality, the option to take a 
virtual course with an average teacher (or an 
average-ability peer group) might be more ad¬ 
vantageous to a student attending a brick-and- 
mortar school with very low-quality teachers 
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(or very low-achieving peers). This would sug¬ 
gest that a potential benefit of the expansion 
of virtual courses could be to reduce the in¬ 
equality in educational opportunities for more 
affluent versus poorer students, given that past 
research indicates that high-poverty schools 
tend to be staffed by teachers with less experi¬ 
ence and lower value-added scores (Sass et al. 
2012; Boyd et al. 2008) and that, within schools, 
classes with a higher share of low-achieving, 
poor, and minority students are most likely to 
receive novice teachers (Kalogrides and Loeb 
2013). 

Despite heated debate in the policy realm, 
there has been little rigorous research examin¬ 
ing the effect on student achievement of online 
courses in comparison to FtF courses. The ma¬ 
jority of research on the impacts of online 
course-taking comes from studies at postsec¬ 
ondary institutions. There have been several 
careful randomized control trials to compare 
learning for college students in FtF classes ver¬ 
sus hybrid delivery models. These studies tend 
to find either null results (Bowen et al. 2014) or 
modest benefits to FtF instruction (Figlio, 
Rush, and Yin 2013; Joyce et al. 2015). 5 These 
studies, however, look only at a limited range 
of classes (for example, one section of statis¬ 
tics or economics) and tend to be based in se¬ 
lective institutions. Other studies use quasi- 
experimental methods to explore the impact 
of virtual course-taking at less elite, broad- 
access institutions. Studies of public commu¬ 
nity colleges in a variety of states (Xu and Jag- 
gars 2011,2013; Hart, Friedmann, and Hill 2014; 
Streich 2014) and of for-profit broad-access in¬ 
stitutions operating nationally (Bettinger et al. 
2015) consistently find poorer outcomes for 
students who take online courses. However, 
given the greater latitude that postsecondary 
instructors generally have to develop courses, 
online course-taking may have different ef¬ 
fects for K-12 students. 

Unfortunately, little evidence of the effects 
of online learning exists at the K-12 level. In¬ 
deed, a recent meta-analysis of online learning 


has found only five studies that compare stu¬ 
dents in K-12 online courses to an FtF alterna¬ 
tive that features an experimental or quasi- 
experimental design and includes sufficient 
information to be included in a meta-analysis 
(Means et al. 2010). Of these studies, all use 
blended rather than fully online instruction. 
The authors find no significant differences be¬ 
tween blended and FtF alternatives in K-12 set¬ 
tings, a finding echoed in other meta-analyses 
with slightly less stringent inclusion criteria 
(Cavanaugh et al. 2004). 

The best test of whether online coursework 
boosts student learning for K-12 students comes 
from a randomized controlled trial for stu¬ 
dents taking Algebra I. Cavalluzzo et al. (2012) 
compare a hybrid Algebra I curriculum imple¬ 
mented in thirteen high schools in Kentucky 
to an FtF curriculum and find no evidence of 
a difference in learning. Although the Ken¬ 
tucky study provides compelling evidence with 
regard to this particular course and context, 
the results from this context may not general¬ 
ize. We return to the evidence on blended 
learning models in the following section. 6 

Online Instruction in Florida 

To shed light on some of these unanswered 
questions, we examine virtual course-taking in 
Florida. Florida is a sensible location for study¬ 
ing online learning because it is one of only a 
few states that require students to take at least 
one online course in order to receive a high 
school diploma (Watson et al. 2012). This re¬ 
quirement can be met through an online course 
offered by the Florida Virtual School (FLVS, a 
virtual education provider approved by the 
State Board of Education and the largest vir¬ 
tual course provider in Florida), a high school, 
or an online dual-enrollment course. Florida’s 
virtual schools are subject to many of the same 
regulations that FtF schools face. In order for 
the state to pay for classes, curricula in virtual 
schools must be aligned to the state’s stan¬ 
dards and teachers must be fully credentialed 
in Florida. Also, like brick-and-mortar schools, 


5. Lectures in Figlio, Rush, and Yin (2013) were delivered fully online, but those students had access to FtF time 
with instructors during traditional office hours as well. 

6. Several recent studies that focus on full-time virtual schools serving K-12 students find mixed results (see 
Center for Research on Educational Outcomes 2011; Molnar et al. 2013; Ritter and Lueken 2013). 
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virtual schools that provide state-funded full¬ 
time education for students receive grades 
through Florida’s accountability system. 7 

The vast majority of students taking online 
courses in Florida do so through FLVS, a public 
school founded in 1997 that provides courses 
for both full-time and part-time online stu¬ 
dents. Most commonly, students access online 
courses at home or another location with 
broadband access such as a public library. 
FLVS fills courses on a first-come, first-served 
basis. Each course in FLVS has a maximum en¬ 
rollment size, and FLVS fills courses sequen¬ 
tially—that is, students are assigned a particu¬ 
lar teacher until that teacher reaches his or her 
enrollment cap, at which point FLVS opens 
another “section” of the course (Teresa King, 
FLVS, personal communication, July 2013). Stu¬ 
dents are accepted on a rolling basis, and they 
can work at their own pace. Given the flexibil¬ 
ity of course pacing, FLVS instructors tend to 
be “on call” from 8:00 AM to 8:00 PM, Monday 
through Sunday (Balcia et al. 2011). Indeed, 
FLVS teachers are required to respond to any 
student query within twenty-four hours and to 
return completed assignments with feedback 
within forty-eight hours (Teresa King, FLVS, 
personal communication, July 2013). 

FLVS teachers are not unionized, but they 
are paid on the basis of a traditional salary 
schedule comparable to other public districts, 
with salary increases for experience and addi¬ 
tional education. FLVS teachers complete a 
one-week in-person training session upon in¬ 
duction and receive thirty hours of additional 
training (delivered virtually) each year. 

FLVS maintains tight control over the cur¬ 
riculum presented to students (Teresa King, 
personal communication, August 9, 2013). The 
school’s Curriculum Services Department de¬ 
signs the curriculum and student assignments, 
and teachers have little latitude to alter the as¬ 
signments. All courses include discussion- 
based assignments in which students talk with 


teachers (by phone) about the material so that 
the instructor can assess student understand¬ 
ing and clarify questions in real time. 8 All stu¬ 
dents in the same course take centrally de¬ 
signed exams in which questions drawn from 
a test bank are randomly presented to stu¬ 
dents. Final exams are proctored only if teach¬ 
ers raise concerns about academic integrity. 

In recent years, many public schools have 
begun offering virtual courses during the 
school day within the school building (for ex¬ 
ample, in a computer lab or school library). In 
such cases, the course is described as a virtual 
learning lab (VLL). 

Data and Sample 

We draw on data from two main sources for 
our examination of virtual course-taking in 
Florida. To characterize growth across all sec¬ 
tors, we draw on student enrollment data from 
the Florida Virtual School. All other tables rely 
on data from the Florida Department of Edu¬ 
cation (FDOE). Using FDOE data, we assem¬ 
bled a student-level longitudinal data set for 
all public school students in Florida from 
2005-2006 through 2013-2014. Because our 
data are drawn from high school transcripts, 
we limit our sample to students in grades 9 to 
12 who attend traditional, charter, or mag¬ 
net public schools. 9 Because a subset of the 
variables we construct rely on next-year out¬ 
comes, many of our results will focus on the 
2012-2013 school year. In that year, we observe 
6,501,111 course enrollments taken by 801,480 
students. 

The FDOE high school transcript data pro¬ 
vide information on the institutions that pro¬ 
vide instruction for each class, allowing us to 
identify courses provided by virtual schools. In 
addition, the FDOE data include demographic 
background characteristics (student sex, race- 
ethnicity, subsidized lunch use); classification 
in special programs (limited English profi¬ 
ciency, special education, gifted programs); 


7. 2013 Florida Statutes, Title XLVIII (K-20 Education Code), Chapter 1002.45 (virtual instruction programs). 

8. These calls also help FLVS identify instances of student cheating—for example, if the level of student under¬ 
standing revealed during a phone call does not match that student's performance on written assignments. 

9. We drop a small number of observations (fewer than 5 percent) where students attended special education 
schools, alternative schools, career or vocational education schools, or schools run by the Department of Juvenile 
Justice. 
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and student outcomes (statewide standardized 
test scores and grades) for all students. 

To obtain school characteristics, we merge 
data on students’ home institutions (the brick- 
and-mortar institutions in which students are 
enrolled, also sometimes called their “enroll¬ 
ment institutions”) from the Common Core of 
Data (CCD) files maintained by the National 
Center for Education Statistics (NCES). Spe¬ 
cifically, NCES data are used to characterize 
schools’ urbanicity, charter or magnet school 
status, total enrollment, and share of students 
using free or reduced-price (FRL) lunch. We de¬ 
scribe several sources of data on specific mea¬ 
sures of in-school and out-of-school access to 
technological resources later in the paper. 

The Distribution of Resources Across 
Schools in Florida 

Before analyzing virtual course-taking in Flor¬ 
ida, it is useful to review how resources are dis¬ 
tributed across schools in the state. The Cole¬ 
man Report documented dramatic differences 
in the 1960s in resources such as spending and 
class size across schools attended by black and 
white children. But many things have changed 
since the time of the report. 

Table 1 presents descriptive statistics on the 
distribution of various resources for students 
across quartiles based on the share of the stu¬ 
dent body using subsidized meals. For exam¬ 
ple, quartile 1 includes schools with the lowest 
fraction of students eligible for subsidized 
meals in the sample—namely, fewer than 36 
percent of students. Conversely, quartile 4 in¬ 
cludes schools with the highest fraction of stu¬ 
dents eligible for subsidized meals—at least 71 
percent of low-income students. The fifth col¬ 
umn in the table gives the F-statistic and p- 
value for regression-based tests of whether 
there are differences across quartiles in the ex¬ 
tent to which schools offer each resource. 

As measures of traditional resources, we 
focus on teacher advanced degree-holding, 
teacher experience, and school student-to- 
teacher ratios. There is considerable evidence 
that teacher experience, particularly in the first 
few years, is strongly correlated with student 
achievement (Nye, Konstantopoulos, and 
Hedges 2004; Rivkin, Hanushek, and Kain 
2005). Although many studies fail to find a sim¬ 


ilar benefit to teacher advanced-degree receipt 
(Harris and Sass 2011; Rivkin, Hanushek, and 
Kain 2005; but see Clotfelter, Ladd, and Vigdor 
2007), we view this as the best available proxy 
for unmeasured teacher quality. Student-to- 
teacher ratios proxy for school class sizes; evi¬ 
dence suggests that achievement is enhanced 
by smaller class sizes (Angrist and Lavy 1999; 
Jepsen and Rivkin 2009; Krueger 1999; but see 
Hoxby 2000). 

High-poverty schools have significantly 
fewer teachers with advanced degrees and sig¬ 
nificantly more teachers with three or fewer 
years of experience. For example, roughly 45 
percent of teachers in the most advantaged 
schools have advanced degrees compared with 
fewer than 40 percent of teachers in the highest- 
poverty schools. About 31 percent of teachers 
in quartile 1 schools are novices compared 
with nearly 37 percent in quartile 4 schools. 
However, low-SES schools have lower student- 
to-teacher ratios than do higher-SES schools, 
probably because of the supplemental funding 
provided to these schools. 

The success of virtual instruction requires 
access to the appropriate technology. Given the 
inequitable distribution of traditional resources 
across schools, one should naturally be con¬ 
cerned about the distribution of technology ac¬ 
cess. We use two sources of data to establish 
the technological resources available at the 
school level. The first is the October 2014 report 
on connectivity capability in Florida, “Com¬ 
munity Anchor Institutions,” including K-12 
schools, conducted by the Florida Department 
of Management Services (FLDMS) and pro¬ 
vided to the National Telecommunications and 
Information Administration (NTIA) for its State 
Broadband Initiative (SBI) (Florida Depart¬ 
ment of Management Services 2014). The re¬ 
port provides maximum download speeds 
for the service to which each institution sub¬ 
scribes. We dichotomize this to capture whether 
schools report download speeds of 100 mega¬ 
bits per second or greater; this is the median 
download speed reported for schools, and it 
corresponds roughly with what experts view is 
the minimum acceptable speed for network¬ 
ing. 

The second source of data comes from the 
fall 2014 “Technology Resources Inventory” 


Table 1. Student Access to Resources by Quartile of School (Fraction of Students Using Free or Reduced-Price Lunch, 2012-2013) 
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Source: Authors' tabulations from Florida Department of Education Data Warehouse (FLD0E EDW); National Center for Education Statistics (NCES); National 
Telecommunications and Information Administration, State Broadband Initiative (NTIA SBI); Florida Department of Education School Technology Resources In¬ 
ventory (FLDOE TRI); and Florida Department of Management Services report, "Community Anchor Institutions" (FLDMS CAI), made available through NTIA. 
Notes: Units = unique schools. Quartiles defined to hold roughly equal numbers of schools. Poverty quartile cut-points at 36.07 percent, 54.50 percent, and 
70.95 percent. 
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surveys collected by the Florida Department 
of Education (Florida Bureau of Educational 
Technology 2014). 10 These surveys ask schools 
to report on their technology environment, in¬ 
cluding the source and speed of Internet at the 
school. We create two measures of in-school 
technological resources from this survey. The 
first is a measure of computers per student. 
Schools report the number of desktop and mo¬ 
bile computers in the school that are used for 
student instruction and that meet certain min¬ 
imum technical standards in terms of memory, 
processing speeds, and so on. 11 We standardize 
this measure by the school enrollment. The 
second is a measure of wireless service in the 
school. The Technology Resources Inventory 
surveys ask schools to report the number of 
IEEE 802.11n compliant wireless access points 
in the building. Wireless access points allow 
wireless devices to connect to wired networks 
using Wi-Fi. This measure is standardized by 
the number of classrooms in the building as a 
proxy for the physical space that the wireless 
access points are working to cover. 

Table 1 suggests that there is less discrep¬ 
ancy across socioeconomic categories for tech¬ 
nological resources than for nontechnological 
ones. Indeed, high-poverty schools have more 
computers per student than do lower-poverty 
schools. Few of the other resources have clear 
relationships to socioeconomic status. 

Success in online courses is likely to de¬ 
pend, at least in part, on access to high-speed 
Internet outside of school. And here the so- 
called digital divide might be an important 
constraint on the ability of virtual instruction 
to reduce the achievement gap. Our supple¬ 
mental calculations on home Internet access 
among households with school-age children 
(five to eighteen) using 2013 and 2014 American 
Community Survey (ACS) data (Ruggles et al. 
2015) suggest that affluent children are more 
likely to have home access to high-speed Inter¬ 
net than their low-income peers. Among house¬ 


holds with family income at or below the pov¬ 
erty line, 42.6 percent lack access to high-speed 
Internet options (including DSL, cable Internet 
service, satellite Internet service, fiber-optic In¬ 
ternet service, or mobile broadband plans). 
Over 20 percent of households above the pov¬ 
erty threshold but still below the threshold for 
subsidized lunch eligibility (185 percent of the 
federal poverty line) lack high-speed Internet 
access, while fewer than 10 percent of house¬ 
holds not eligible for free or reduced-price 
lunch lack such access. 

Because, unfortunately, we do not have data 
on each student’s access to high-speed Inter¬ 
net at home, we rely on two school-level prox¬ 
ies. In the Technology Resources Inventory 
surveys, school administrators are asked to es¬ 
timate the fraction of students in their school 
who have access to high-speed Internet at 
home. We supplement this information with 
information on the geographic distribution of 
broadband providers collected by the NTIA 
and the Federal Communications Commission 
(FCC) (U.S. Department of Commerce 2014). 
Following Lisa Dettling, Sarena Goodman, and 
Jonathan Smith (2015), we aggregate block- 
level information on residential broadband 
providers to create the population-weighted 
number of providers of residential broadband 
service in the school’s ZIP code, which serves 
as our measure of at-home access to high¬ 
speed Internet at the school level. 

Out-of-school technological resources show 
clearer relationships to socioeconomic status. 
Schools with higher-SES student bodies esti¬ 
mate that a larger percentage of their students 
have access to the Internet outside of school; 
the estimated rate of out-of-school Internet ac¬ 
cess is 85 percent in the lowest-poverty schools 
versus 58 percent in schools with the highest 
poverty rates. Schools in higher-poverty areas 
are also less likely to be located in ZIP codes 
with at least one broadband provider per 2,700 
people. Nearly 75 percent of low-poverty schools 


10. For an example of the survey layout and responses for a single school, see: http://www.flinnovates.org 
/survey/FIinnovateslnventory/Reports/SchoolsPublicRpt?schoolCode=05%203011&inventoryTypeld=2 (ac¬ 
cessed June 28, 2016). 

11. Standards include 1GHz or faster processor; 1GB RAM or greater memory; 1024-by-768 screen resolution; 
and 9.5-inch (10-inch class) or larger screen size measured diagonally. Windows computers must use Windows 
7 or higher; Apple computers must use MAC OS X 10.7 or higher. 
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Figure 1. Change over Time in Florida Virtual School Enrollments 



Source: Authors' calculations from FLVS data. 


are located in broadband-rich communities 
versus about 65 percent of the highest-poverty 
schools. 

Findings 

Virtual course enrollments have expanded dra¬ 
matically in the last decade. Figure 1 illustrates 
this using FLVS data from 2005-2006 through 
2012-2013 for four different schooling sectors: 
public schools, private schools, charter schools, 
and home schools. We see dramatic enroll¬ 
ment growth over this period, particularly 
among public school students. For example, 
the number of total enrollments in virtual 
courses across all school types grew from just 
under 50,000 in 2006 to roughly 350,000 by 
2013, with public school enrollments in virtual 
courses accounting for roughly three-quarters 
of all enrollments in the last year. 

Virtual course-taking rates appear roughly 
constant across the core academic subject ar¬ 
eas in 2012-2013, with math, social studies, En¬ 
glish language arts, foreign language, and sci¬ 
ence each accounting for 9 to 15 percent of 
virtual course enrollments (table 2). Interest¬ 
ingly, physical education and driver’s educa¬ 
tion are also among the most popular virtual 


courses, accounting for 4 and 14 percent of en¬ 
rollments, respectively. Note that while each of 
the subjects listed has seen explosive growth 
in enrollments over time, the growth is espe¬ 
cially marked in some areas; foreign languages, 
for instance, had more than a 1,000 percent 
increase in enrollments from 2005-2006 to 
2012-2013. 

During the 2012-2013 school year, nearly 21 
percent of students took at least one virtual 
course. Virtual courses constituted about 4 
percent of total course enrollments, suggest¬ 
ing that students who take any virtual courses 
take about one out of five of their courses on¬ 
line. 12 Table 3 presents virtual course-taking 
rates separately by student and school charac¬ 
teristics. 

Students who were more advantaged, both 
academically and economically, appear to have 
been more likely to take virtual courses. For ex¬ 
ample, only 17.6 percent of students who were 
eligible for subsidized meals took a virtual 
course, and only 13.1 percent of students receiv¬ 
ing special education services did so (column 
1). By contrast, over 27 percent of gifted stu¬ 
dents took virtual courses. This finding is 
echoed by differences in virtual course-taking 


12. This seemingly high rate is probably due to the requirement that, as mentioned earlier, all Florida high school 
students must take a virtual course as of the cohort that entered ninth grade in 2011-2012 (Watson et al. 2012). 
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Table 2. Florida Virtual School Course Enrollments in Different Subject Areas, 2006 and 2013 



2006 

2013 

Percent Change 
2006 to 2013 

Math 

5,601 

45,577 

714% 


(14%) 

(15%) 


Driver's education 

0 

44,261 




(14%) 


Social studies 

7,192 

43,381 

503 


(18%) 

(14%) 


English language arts 

5,654 

40,798 

622 


(14%) 

(13%) 


Foreign languages 

3,247 

38,852 

1,097 


(8%) 

(12%) 


Science 

4,233 

29,082 

587 


(11%) 

(9%) 


Physical education 

6,961 

13,674 

96 


(17%) 

(4%) 


Business technology and computer science 

1,931 

7,641 

296 


(5%) 

(2%) 


Other 

5,154 

51,122 

892 


(13%) 

(16%) 


Total 

39,973 

314,388 



100% 

100% 



Source: Authors' calculations from Florida Department of Education Data. 

Notes: Counts represent unique student-course combinations. Percentages represent the share of vir¬ 
tual student-course enrollments taken in each subject area, but may not sum to exactly 100 percent 
due to rounding used here. Courses that span multiple semesters in the same year count only once. 


based on students’ eighth-grade standardized 
test scores. Students are characterized accord¬ 
ing to the quartile into which their average 
standardized math and reading scores fall. 
Nearly 27 percent of students scoring in the top 
quartile of eighth-grade standardized tests 
(not shown) took a virtual course compared 
with only 14 percent of students in the bottom 
quartile, and the likelihood of taking any vir¬ 
tual class increased monotonically with prior 
achievement quartile. African American and 
Latino students were significantly less likely 
than average to take a virtual class in 2012- 
2013, and Asian students were significantly 
more likely than average to take one. The 
pattern of results is nearly identical using 
enrollment-weighted estimates (column 2): 
high-achieving students and higher-income 
students took a higher share of their courses 
virtually compared to their lower-achieving 
and less affluent peers. 


Students in traditional public schools were 
the most likely to take at least one course on¬ 
line (22.62 percent); virtual course-taking was 
less prevalent in charter (20.68 percent) and 
magnet (18.65 percent) schools. Rural students 
had the lowest prevalence of virtual course¬ 
taking on both measures. Mirroring the student- 
level results, we see that the poorest schools 
had the lowest rates of virtual course-taking. 
Virtual course-taking was also somewhat more 
prevalent among students with access to 
higher-quality teachers, measured by on-paper 
credentials. In particular, virtual course-taking 
was more prevalent in schools with higher con¬ 
centrations of novice teachers (18.5 percent) 
versus those with lower concentrations of nov¬ 
ice teachers (22.38 percent). 

Surprisingly, in-school technological re¬ 
sources had little relationship to online course¬ 
taking. Indeed, students in schools with more 
computers per student were actually some- 
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Table 3. Virtual Class-Taking Prevalence in Florida in 2012-2013 



Share of Students Taking 
At Least One Virtual 

Course (%) 

Share of Classes 
Taken Virtually (%) 

All students 

20.82 

4.10 

By student characteristics 

Eligible for subsidized meals 

17.63 

3.31 

Female 

24.67 

4.98 

Black 

19.12 

3.31 

Hispanic 

16.48 

3.14 

Asian 

26.39 

5.09 

Other race/race missing 

23.48 

5.04 

Limited English proficiency 

14.70 

2.60 

Gifted 

27.16 

5.11 

Special education 

13.09 

2.54 

Eighth-grade test score: first (lowest) quartile 

13.95 

2.64 

Eighth-grade test score: second quartile 

19.85 

3.74 

Eighth-grade test score: third quartile 

22.94 

4.38 

Eighth-grade test score: fourth (highest) quartile 

26.62 

5.10 

Grade 9 

16.63 

3.20 

Grade 10 

21.86 

4.11 

Grade 11 

20.72 

4.38 

Grade 12 

24.84 

4.88 

By school characteristics 

Charter 

20.68 

3.56 

Magnet 

18.65 

3.29 

Traditional public school 

22.62 

4.74 

Urban 

20.37 

4.45 

Suburban 

21.22 

3.88 

Rural 

19.95 

3.68 

By percentage of students eligible for 
subsidized meals 

First (lowest) quartile 

25.33 

5.09 

Second quartile 

23.06 

4.92 

Third quartile 

19.02 

3.36 

Fourth (highest) quartile 

15.89 

2.70 

In-school nontechnological resources 

Share of teachers with advanced degrees greater 

21.06 

4.42 

than 45 percent 

Share of teachers with advanced degrees 45 

20.59 

3.69 

percent or less 

Share of teachers with zero to three years of 

18.50 

3.31 

experience greater than 25 percent 

Share of teachers with zero to three years of 

22.38 

4.47 

experience 25 percent or less 

Share of teachers with ten or more years of 

22.10 

4.08 

experience greater than 45 percent 

Share of teachers with ten or more years of 

experience 45 percent or less 

19.38 

3.88 

Pupil-teacher ratio of 19:1 or less 

20.38 

3.72 

Pupil-teacher ratio greater than 19:1 

20.76 

3.74 
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Table 3. (continued) 



Share of Students Taking 
At Least One Virtual 

Course (%) 

Share of Classes 
Taken Virtually (%) 

In-school technological resources 



School maximum download speed of 100 megabits 
per second or higher 

20.53 

3.68 

School maximum download speed of less than 100 
megabits per second 

20.01 

3.48 

More than 0.33 computers per student 

19.08 

3.35 

0.33 computers per student or less 

22.10 

4.03 

More than 0.67 wireless access points per 
classroom 

19.88 

3.52 

0.67 wireless access points per classroom or less 
Proxies for out-of-school internet resources 

20.45 

3.66 

More than 75 percent of students have internet 

access 

22.38 

4.05 

75 percent or less of students have internet access 

18.60 

3.28 

One or more residential broadband provider per 
2,700 people (ZIP code) 

21.54 

4.21 

Less than one residential broadband provider per 
2,700 people (ZIP code) 

18.89 

3.51 


Source: Authors' tabulations based on data from the FLDOE EDW, NCES, FLDMS CAI, NTIA SBI, and FLDOE 
TRI. (See table 1 source note.) 

Note: FCAT quartiles are based on average of eighth-grade math and reading scores. 


what less likely to take online courses. Our out- 
of-school proxy measures were more predictive 
of online course-taking. Students from schools 
where over 75 percent of students were esti¬ 
mated to have out-of-school access to the In¬ 
ternet were more likely (22.4 percent) to have 
taken at least one online course than were stu¬ 
dents in schools with less estimated home In¬ 
ternet access (18.6 percent). Likewise, students 
attending schools in ZIP codes with greater 
residential broadband provision (at least one 
provider per 2,700 people) had higher virtual 
course-taking rates (21.5 percent) than did stu¬ 
dents in more sparsely serviced areas (18.9 per¬ 
cent). 

Although we see students from all different 
school and family backgrounds taking virtual 
courses, they may be differentially likely to do 
so based on their reasons for taking a particu¬ 
lar class. To explore this possibility, table 4 


breaks down the share of virtual class enroll¬ 
ments by the reason for attempting these 
classes. We distinguish four types of attempts, 
which we impute based on whether students 
had previously taken the same class and past 
performance in the class if it was previously 
taken. Classes are designated as “first attempts” 
if students had never taken the same course in 
any previous year. “Credit recovery” classes are 
flagged when students had taken the same 
course in a previous year and received a failing 
grade. “Grade improvement” is flagged if stu¬ 
dents had taken the same course in a previous 
year and received a D grade but never an F. 
“Other attempts” (not shown) are flagged when 
students had taken the same course across 
multiple years but there was no evidence that 
they had done so owing to poor prior perfor¬ 
mance. 13 

The top panel presents the prevalence of 


13. "Other attempts" include both classes that could be taken multiple times for credit (like some special educa¬ 
tion courses) and cases where students took one term of a class in one year and a second term in a subsequent 
year. 





Table 4. Florida Virtual Class Enrollments in 2012-2013 Conditional on Attempt Type 
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Source: Authors' tabulations from FLD0E data. 

Notes: FCAT = Florida Comprehensive Assessment Test, AP = Advanced Placement, and IB = International Baccalaureate. Core courses include math, English, 
language arts, science, and social studies and exclude AP/IB courses. "Life skills" includes physical education, driver's education, and health. 
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course-taking conditional on attempt type for 
all students (column 1) and by student charac¬ 
teristics of interest, including subsidized lunch 
use (free or reduced-price lunch versus full- 
price lunch); race (black, Hispanic, and white 
or Asian); and prior achievement (students in 
the highest and lowest Florida Comprehensive 
Assessment Test [FCAT] achievement quar- 
tiles). Among the full population of students, 
we see that students took the smallest share of 
their first attempts at a course virtually. Only 
3.7 percent of first attempts at classes were 
taken virtually, compared to over 13 percent of 
attempts at credit recovery and nearly 12 per¬ 
cent of attempts at grade improvement. 

Columns 2 to 7 give these breakdowns for 
different subtypes of students. Across all course 
types, students on subsidized lunch took a 
lower share of their courses virtually than did 
their more affluent peers. In some cases, the 
differences are quite sizable: more affluent chil¬ 
dren took over twice as many virtual courses in 
credit recovery attempts compared to lower- 
income children, and over three times more in 
grade improvement attempts. White and Asian 
children also took a higher share of virtual 
courses across all class types compared to their 
black and Hispanic peers. The gaps are most 
dramatic when comparing lower-achieving and 
higher-achieving children. Students in the 
highest quartile of FCAT performance were 
nearly four times more likely to make their 
credit recovery attempts virtually and were 
roughly eighteen times more likely to make 
their grade improvement attempts virtually. 14 

The bottom panel presents the share of vir¬ 
tual courses taken within each attempt type for 
five different types of courses. “Core subjects” 
includes math, science, social studies, and En¬ 
glish language arts. “Foreign languages” cov¬ 
ers foreign language offerings, and “life skills” 
includes health, physical education, and driv¬ 
er’s education classes. “Other electives” in¬ 
cludes all other subjects. We removed Advanced 


Placement (AP) and International Baccalaure¬ 
ate (IB) classes from these four types of courses; 
these accelerated options are presented sepa¬ 
rately as “AP/IB” classes. 

Virtual course-taking is not equally preva¬ 
lent in all course areas. Aggregating all attempt 
types (row 5), life skills and foreign language 
courses were most often taken virtually— 
roughly 8 to 10 percent. By contrast, only about 
3.5 percent of core courses and 3 percent of 
other elective classes were taken virtually. Vir¬ 
tual course-taking was very uncommon for AP/ 
IB classes: fewer than 1 percent of students 
took their AP and IB courses virtually. 

There are a few surprising patterns when 
these results are broken down by course at¬ 
tempt types. For instance, though fewer than 
1 percent of AP classes were taken virtually, a 
very high share of grade improvement (38 per¬ 
cent) and credit recovery (24 percent) attempts 
in AP/IB classes were made virtually. 15 Likewise, 
nearly one-third of credit recovery attempts 
and over 40 percent of grade improvement at¬ 
tempts in foreign language courses were made 
virtually. This suggests that virtual classes 
serve different purposes for students depend¬ 
ing on the class type. 

In an effort to distinguish the association 
between virtual course-taking and specific stu¬ 
dent and school characteristics, table 5 pre¬ 
sents estimates from OLS regressions. The unit 
of observation in these regressions is a student- 
course, so in most cases there will be multiple 
observations for each student. We predict the 
likelihood that a course will be taken virtually 
given the characteristics of the student taking 
the class and the student’s home institution. 
Standard errors are all clustered at the school 
(home institution) level, which subsumes all 
observations for each student. 

Each column reflects the results from a sep¬ 
arate regression, with the sample indicated in 
the top row. Columns 1 and 2 focus on all 
course types and all attempt types shown in 


14. Although relatively few high-achieving students took classes for credit recovery or grade improvement pur¬ 
poses, each category still had several thousand enrollments: we observe about 2,250 grade improvement at¬ 
tempts and about 7,500 credit recovery attempts for the highest-achieving students. This suggests that the high 
numbers are not purely an artifact of unstable measures due to small sample sizes. 

15. This is on a very small base of 200 to 450 enrollments each for AP credit recovery and grade improvement 
attempts. 
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Table 5. Predictors of Online Course-Taking, 2012-2013 



(1) 

Any 

Course 

Type, Any 
Attempt 

(2 

Any 

Course 

Type, Any 
Attempt 

(3) 

Any 

Course 

Type, Any 
Attempt 

(4) 

Core 

Classes, 

First 

Attempt 

(5) 

All 

Classes, 

Credit 

Recovery 

(6) 

AP 

Classes, 

Any 

Attempt 

Student characteristics 







Free or reduced-price lunch 

-0.006*** 

-0.006*** 

-0.006*** 

-0.003*** 

-0.055*** 

0.000 


(0.000) 

(0.000) 

(0.000) 

(0.000) 

(0.003) 

(0.000) 

Female 

0.019*** 

0.019*** 

0.019*** 

0.010*** 

0.038*** 

- 0.000 


(0.001) 

(0.001) 

(0.000) 

(0.000) 

(0.002) 

(0.000) 

Black 

-0.004*** 

-0.004*** 

-0.005*** 

-0.005*** 

-0.020*** 

0.001 


(0.001) 

(0.001) 

(0.000) 

(0.001) 

(0.004) 

(0.001) 

Hispanic 

-0.009*** 

-0.009*** 

-0.008*** 

-0.008*** 

-0.027*** 

-0.001* 


(0.001) 

(0.001) 

(0.000) 

(0.001) 

(0.004) 

(0.001) 

Asian 

0.010*** 

0.009*** 

0.009*** 

0.006*** 

0.019 

0.008*** 


(0.001) 

(0.001) 

(0.001) 

(0.002) 

(0.013) 

(0.002) 

Limited English proficiency 

-0.007*** 

-0.006*** 

-0.003*** 

-0.005*** 

-0.030*** 

- 0.000 


(0.001) 

(0.001) 

(0.000) 

(0.001) 

(0.004) 

(0.001) 

Gifted 

0.004** 

0.004*** 

0.009*** 

0.004* 

0.074*** 

-0.001 


(0.002) 

(0.002) 

(0.001) 

(0.002) 

(0.014) 

(0.001) 

Special education 

-0.009*** 

-0.009*** 

-0.007*** 

-0.004*** 

-0.027*** 

0.002 


(0.001) 

(0.001) 

(0.000) 

(0.001) 

(0.003) 

(0.001) 

Composite eighth-grade FCAT 

0.010*** 

0.010*** 

0.010*** 

0.006*** 

0.043*** 

0.005*** 

(standard) 

(0.000) 

(0.000) 

(0.000) 

(0.000) 

(0.002) 

(0.001) 

School characteristics 







Charter 

-0.046*** 

-0.035** 


-0.042*** 

-0.050 

-0.004 


(0.018) 

(0.015) 


(0.016) 

(0.043) 

(0.006) 

Magnet 

-0.010*** 

-0.010*** 


-0.010*** 

-0.036*** 

-0.003 


(0.004) 

(0.004) 


(0.003) 

(0.010) 

(0.002) 

Urban 

0.001 

0.001 


0.003 

-0.013 

0.002 


(0.004) 

(0.004) 


(0.004) 

(0.010) 

(0.002) 

Rural 

-0.008** 

-0.001 


- 0.000 

-0.017 

- 0.000 


(0.004) 

(0.005) 


(0.005) 

(0.012) 

(0.002) 

Log enrollment 

-0.007 

0.006 


0.005 

-0.007 

0.005 


(0.009) 

(0.011) 


(0.012) 

(0.016) 

(0.006) 

Fraction of enrollment on free or 

0.011 

0.035 


0.037 

-0.099** 

0.008 

reduced-price lunch 

(0.020) 

(0.023) 


(0.023) 

(0.049) 

(0.013) 

Fraction of enrollment black/ 

0.003 

-0.002 


-0.009 

0.164*** 

-0.011* 

Hispanic 

(0.011) 

(0.010) 


(0.010) 

(0.031) 

(0.007) 

School mean: eighth-grade FCAT 

0.035*** 

0.045*** 


0.039*** 

0.189*** 

0.002 


(0.012) 

(0.013) 


(0.012) 

(0.036) 

(0.007) 

Grade: A 

-0.007* 

-0.007* 


-0.008** 

-0.016 

-0.001 


(0.004) 

(0.004) 


(0.004) 

(0.013) 

(0.003) 

Grade: B 

-0.001 

0.001 


0.002 

0.005 

-0.001 


(0.004) 

(0.004) 


(0.004) 

(0.012) 

(0.003) 

Grade: D 

0.005 

0.007 


0.002 

0.021 

0.003 


(0.008) 

(0.008) 


(0.009) 

(0.020) 

(0.005) 

Grade: F 

0.020 

0.019 


0.025 

0.011 

-0.001 


(0.016) 

(0.016) 


(0.019) 

(0.041) 

(0.007) 
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Table 5. (continued) 



(1) 

(2 

(3) 

(4) 

(5) 

(6) 


Any 

Any 

Any 

Core 

All 

AP 


Course 

Course 

Course 

Classes, 

Classes, 

Classes, 


Type, Any 

Type, Any 

Type, Any 

First 

Credit 

Any 


Attempt 

Attempt 

Attempt 

Attempt 

Recovery 

Attempt 

Nontechnological school resources 







Fraction of teachers with 

0.047** 

0.041** 


0.054*** 

0.071 

0.023* 

advanced degrees 

(0.021) 

(0.018) 


(0.019) 

(0.047) 

(0.013) 

Fraction of teachers with zero to 

-0.004 

-0.028* 


-0.027 

-0.078** 

-0.018* 

three years of experience 

(0.018) 

(0.016) 


(0.017) 

(0.037) 

(0.009) 

Student-to-teacher ratio 

- 0.000 

-0.001 


-0.001 

0.000 

-0.001 


(0.001) 

(0.001) 


(0.001) 

(0.002) 

(0.000) 

In-school technological resources 







School maximum download speed 


0.005* 


0.002 

-0.023** 

-0.001 

100 megabits per second or 
higher 


(0.003) 


(0.003) 

(0.011) 

(0.001) 

Computers per student 


-0.023*** 


-0.020** 

-0.095*** 

0.002 



(0.008) 


(0.008) 

(0.028) 

(0.005) 

Proxies for out-of-school internet 







access 







Fraction of students with 


-0.020** 


-0.023*** 

-0.052* 

-0.008 

nonschool internet access 


(0.009) 


(0.009) 

(0.030) 

(0.005) 

Residential broadband providers 


-0.003 


-0.003 

-0.001 

-0.003** 

per 1,000 people (ZIP code) 


(0.003) 


(0.003) 

(0.012) 

(0.001) 

Sample mean 

0.041 

0.041 

0.041 

0.029 

0.135 

0.009 

School fixed effects 

No 

No 

Yes 

No 

No 

No 

Unique enrollments 

6,186,426 

6,186,426 

6,186,426 

3,124,889 

133,285 

430,516 

Unique schools 

1,234 

1,234 

1,234 

1,099 

648 

645 


Source: Authors' tabulations based on data from the FLDOE EDW, NCES, FLDMS CAI, NTIA SBI, and FLDOE TRI. 
(See table 1 source note.) 

Notes: Missing variable dummies and grade-level dummies are included but not shown. Columns 1 to 3 include 
course-type by attempt-type fixed effects 
***p < .01; **p < .05; *p < .10 


table 3. Consistent with the group compari¬ 
sons presented in table 3, we see that subsi¬ 
dized lunch use is negatively associated with 
virtual course-taking, as is black and Latino 
race-ethnicity and limited English proficiency. 
Gifted students were more likely than non- 
gifted students, and special education students 
less likely than non-exceptional students, to 
take virtual courses. Prior achievement, mea¬ 
sured by the average of the student’s standard¬ 
ized eighth-grade math and English language 
arts FCAT scores, is positively associated with 
virtual course-taking. Courses were less likely 
to be taken virtually in charter and magnet 


schools than in traditional public schools, and 
less likely to be taken virtually in rural schools 
than in suburban schools. School size is nega¬ 
tively associated, and the average eighth-grade 
achievement of the school’s student body is 
positively associated, with the likelihood that 
a course would be taken virtually. Results are 
substantively similar in terms of both the di¬ 
rection and significance of coefficients when 
we use school fixed effects to determine which 
student factors predict virtual course-taking, 
comparing students to their peers in the same 
school (column 2). Specifications that focus 
on characteristics that predict core academic 
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classes being taken virtually on the first at¬ 
tempt (column 4) are also consistent with 
those in column 1, with low-income, male, 
lower-achieving, special education, and black 
and Hispanic students being less likely to take 
these courses virtually. 

Given that virtual course-taking is espe¬ 
cially common for credit recovery attempts, we 
wanted to explore which student characteris¬ 
tics most strongly predict the use of virtual 
courses for credit recovery holding other fac¬ 
tors constant (column 5). Although the pattern 
of results is largely the same as the pattern in 
the first three columns, the magnitude of the 
coefficients is substantially larger. For in¬ 
stance, while subsidized lunch use is associ¬ 
ated with only a 0.7-percentage-point reduc¬ 
tion in the likelihood of taking a given course 
virtually across all classes and attempt types 
(column 1), it is associated with a nearly 
6.0-percentage-point reduction in the likeli¬ 
hood of making credit recovery attempts virtu¬ 
ally (column 4). 

Two competing interpretations may emerge 
from these results. In one interpretation, the 
greater uptake of virtual courses for credit re¬ 
covery by affluent and high-achieving students 
may be evidence that they are using virtual 
classes more strategically. To the extent that 
advantaged students are better poised to ac¬ 
cess the potential benefits of virtual courses 
for credit recovery, these differential patterns 
in uptake could worsen inequality. A second 
interpretation is that students have a good 
read on which course delivery formats are 
most likely to work for them: if lower-achieving 
and relatively disadvantaged students accu¬ 
rately perceive that they would benefit more 
from face-to-face instruction than from virtual 
instruction, the differential patterns in uptake 
would not be worrisome. 

Column 6 focuses on AP/IB courses. Unlike 
in our other specifications, we find few charac¬ 
teristics that predict the likelihood that a stu¬ 
dent will take AP/IB courses virtually: Asian 
students and students with higher prior achieve¬ 
ment were more likely—and charter students, 
students from larger schools, and rural stu¬ 
dents less likely—to take AP courses virtually, 
all else held constant. The latter result is es- 

16. The coefficient on rural is negative even when we do 


pecially surprising. Because rural schools are 
less likely to be able to offer a full suite of AP 
courses, we had anticipated that rural students 
might be especially likely to pursue advanced 
courses online. 16 

Although disadvantaged students are some¬ 
what less likely to take virtual courses, online 
instruction might be more beneficial for these 
students for any of the reasons discussed in 
the prior section. A complete causal analysis 
of the relationship between virtual instruction 
and student achievement is beyond the scope 
of this paper, but we present several figures 
that illustrate how outcomes differ by mode 
of instruction for two popular core academic 
classes: Algebra I and World History. For this 
analysis, we limit our sample to students mak¬ 
ing their first attempt to take these courses in 
2012-2013. We further exclude students who 
were taking these courses at an unusual point 
in their academic career, such as twelfth-graders 
taking Algebra I for the first time. Students are 
characterized according to whether they were 
observed in any term in a virtual section of the 
course under consideration. That is, if they 
were observed in a FtF Algebra I section in one 
term and a virtual Algebra I section the next, 
they appear only in the “ever-virtual” column. 
Students who took all face-to-face classes in 
the relevant course are considered “only-FtF.” 

We examine student performance in the 
next course in the sequence, which we identify 
by examining high school transcripts for all 
students in Florida. For Algebra I, the next 
course is Geometry. For World History, the next 
course could be any of the following: U.S. His¬ 
tory, U.S. Government, or Economics. Grades 
are reported on a standardized four-point 
scale. We compare the cumulative perfect fre¬ 
quency distributions for virtual vs. FtF stu¬ 
dents; at each grade point, the figures depict 
the share of virtual (or FtF) students who re¬ 
ceived that grade or lower. 

Figures 2, 3, 4, and 5 show the distribution 
of subsequent course grades for students tak¬ 
ing Algebra I virtually versus face-to-face, sep¬ 
arately by quartile of eighth-grade math and 
reading scores. Specifically, we group ninth- 
grade students who took Algebra I in 2012-2013 
into quartiles based on the average of their 

not simultaneously control for enrollment. 
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Figure 2. Florida Students' Next-Course Grade, 
Algebra 1, 2012-2013, All Students 
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N = 96,259 N = 1,950 

Source: Authors' calculations from FDOE data. 
Notes: Grade = grade in next course on four-point 
scale. FCAT = Florida Comprehensive Achieve¬ 
ment Test. Quartile based on averaged reading 
and math eighth-grade standardized scores. The 
next course is Geometry. 
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Figure 4. Florida Students' Next-Course Grade, 
Algebra 1, 2012-2013, Quartile 1 (Lowest) FCAT 
Students 
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Source: Authors' calculations from FDOE data. 
Notes: Grade = grade in next course on four-point 
scale. FCAT = Florida Comprehensive Achieve¬ 
ment Test. Quartile based on averaged reading 
and math eighth-grade standardized scores. The 
next course is Geometry. 


Figure 3. Florida Students' Next-Course Grade, 
Algebra 1, 2012-2013, Free or Reduced-Price 
Lunch Students 



- Face-to-face - Virtual 

N = 60,785 N = 820 

Source: Authors' calculations from FDOE data. 
Notes: Grade = grade in next course on four-point 
scale. FCAT = Florida Comprehensive Achieve¬ 
ment Test. Quartile based on averaged reading 
and math eighth-grade standardized scores. The 
next course is Geometry. 

eighth-grade math and reading scores. Overall, 
it appears that students who took the course 
virtually did slightly better than students who 
took the course face-to-face. However, if we 
look separately by prior eighth-grade perfor¬ 
mance, we see that bottom-quartile students 
did worse in Geometry if they took the course 
virtually, while top-quartile students performed 
somewhat better if they took the course virtu¬ 
ally. One complication in these results is that 
a lower share (64 percent) of virtual Algebra I 
students were observed taking Geometry com¬ 
pared to FtF students (72 percent), suggesting 


Figure 5. Florida Students' Next-Course Grade, 
Algebra 1, 2012-2013, Quartile 4 (Highest) FCAT 
Students 
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that virtual students who appear in Geometry 
may be a more positively selected group. 

Results are more positive for virtual course¬ 
taking among World History students (figures 
6, 7, 8, and 9). Although comparable shares of 
virtual and FtF students were observed in fol- 
low-on courses (roughly 68 percent in each sec¬ 
tor), virtual students slightly outperformed 
their FtF peers in each of the samples studied. 
Moreover, the advantages were more pro¬ 
nounced—though still modest—for virtual 
students who qualified for free or reduced- 
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Figure 6. Florida Students' Next-Course Grade, 
World History, 2012-2013, All Students 


i! 

oa | 


•tf ° 
o O 


1 . 0 - 

0 . 8 - 

0 . 6 - 

0.4_ 

0 . 2 - 

0 . 0 - 





- 1 - 1 - 1 -r 

12 3 4 

Next-Course Grade 

- Face-to-face - Virtual 

N = 121,323 N = 3,403 
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Notes: Grade = grade in next course on four-point 
scale. FCAT = Florida Comprehensive Achieve¬ 
ment Test. Quartile based on averaged reading 
and math eighth-grade standardized scores. The 
next course includes U.S. History, U.S. Govern¬ 
ment, or Economics (regular or honors). 


Figure 7. Florida Students' Next-Course Grade, 
World History, 2012-2013, Free or Reduced-Price 
Lunch Students 
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next course includes U.S. History, U.S. Govern¬ 
ment, or Economics (regular or honors). 


price lunch and for students with low eighth- 
grade FCAT scores than they were for their 
higher-achieving peers. 

In interpreting these differences, it is im¬ 
portant to keep in mind that students are 
rarely randomly sorted into a virtual course. In 
most cases, a student can decide whether or 
not to take a course virtually, and this decision 
is likely to be determined by many unobserv¬ 
able as well as observable factors. For this rea¬ 
son, we do not interpret these figures as reflect¬ 
ing the causal impact of the instructional 


Figure 8. Florida Students' Next-Course Grade, 
World History, 2012-2013, Quartile 1 (Lowest) 
FCAT Students 


O hJ 

& o 
cu 

£i T3 
o 6 


1 . 0 - 
0 . 8 - 
0 . 6 - 
0.4 _ 
0 . 2 - 
0 . 0 - 



- 1 - 1 - 1 -r 

12 3 4 

Next-Course Grade 

- Face-to-face - Virtual 

N = 23,364 N = 404 


Source: Authors' calculations from FDOE data. 
Notes: Grade = grade in next course on four-point 
scale. FCAT = Florida Comprehensive Achieve¬ 
ment Test. Quartile based on averaged reading 
and math eighth-grade standardized scores. The 
next course includes U.S. History, U.S. Govern¬ 
ment, or Economics (regular or honors). 


Figure 9. Florida Students' Next-Course Grade, 
World History, 2012-2013, Quartile 4 (Highest) 
FCAT Students 
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mode. In future work, we plan to estimate more 
rigorously the causal impact of virtual instruc¬ 
tion. 


BEYOND VIRTUAL INSTRUCTION 

Our analysis of virtual schooling in Florida 
suggests that virtual course-taking has the po¬ 
tential to be scaled up for broader use. While 
traditionally less advantaged student groups— 
lower-income, nonwhite, lower-achieving—are 
somewhat less likely to take virtual courses, 
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the differences remain relatively modest. More¬ 
over, a large and growing proportion of tradi¬ 
tionally disadvantaged students do enroll in 
and complete online courses. 

However, more equal access to online 
course-taking may not meaningfully affect 
achievement gaps if course quality is not supe¬ 
rior in online courses. We find mixed (descrip¬ 
tive) evidence on the subsequent performance 
of virtual versus face-to-face students. While 
virtual course-taking in World History is posi¬ 
tively associated with performance on subse¬ 
quent social science classes, results are more 
ambiguous for Algebra: free and reduced-price 
lunch students did no better on average, and 
students with low prior achievement did worse, 
in Geometry after taking virtual courses. Al¬ 
though the evidence we have presented should 
certainly not be interpreted causally, it seems 
unlikely that the causal impact is large and 
positive considering that students taking vir¬ 
tual courses are positively selected (on observ¬ 
ables) and thus, if anything, the unconditional 
comparisons we present may overstate the 
benefits of virtual instruction for disadvan¬ 
taged students. Unless the benefits are large 
and positive, at current uptake levels it is un¬ 
likely that virtual schooling will do much to 
improve educational inequality. 

We turn now to explore evidence on a dis¬ 
tinct set of educational technologies that could 
be incorporated in either virtual or face-to-face 
courses to produce better opportunities for 
disadvantaged children. Known as computer- 
aided instruction (CAI) or intelligent tutoring 
systems (ITS), these technologies are designed 
to quickly diagnose and target student needs. 
In this section, we describe these systems, dis¬ 
cuss how they might promote student learn¬ 
ing, and then review the evidence on their ef¬ 
fectiveness. 

The Theory and Development of Computer- 
Aided Instruction 

Broadly speaking, computer-aided instruction 
refers to any computerized learning environ¬ 
ment in which computer software provides in¬ 
struction, practice, and timely feedback to stu¬ 
dents. However, the earliest CAI was not much 


more than a computerized textbook that pro¬ 
vided predeveloped content with very little in¬ 
teractivity. Gradually these programs became 
more flexible, providing relevant content in re¬ 
sponse to student inputs (Nwana 1990). As they 
began to leverage more sophisticated artificial 
intelligence technology, these programs be¬ 
came known as intelligent tutoring systems 
(ITS). 

Intelligent tutoring systems rely on the in¬ 
teraction between its domain and pedagogical 
models and a dynamically updated student 
model (Conati 2009). As a student works 
through problems, completed steps, missteps, 
hint requests, and so on, are used to update 
the student model and estimate the student’s 
understanding; after this estimate is compared 
against domain knowledge models to deter¬ 
mine gaps, the pedagogical model can intel¬ 
ligently implement tutoring strategies to fill 
in these gaps (Graesser, Conley, and Olney 
2012). A fundamental development in newer- 
generation ITS is the ability to diagnose stu¬ 
dent errors and build remediation from these 
diagnoses (Shute and Psotka 1994). Newer in¬ 
telligent tutoring systems also focus on smaller 
“pieces” of the learning process, emphasizing 
individual steps that students must take to 
solve a problem (VanLehn et al. 2005). 

ITS might be expected to influence student 
learning in several ways. Perhaps most impor¬ 
tantly, the growing sophistication of ITS may 
provide teachers with an opportunity to tailor 
content and instructional techniques to each 
student’s individual needs. 17 This type of “dif¬ 
ferentiated instruction” is often cited by re¬ 
searchers and practitioners as the key to effec¬ 
tive teaching, particularly for disadvantaged 
students whose performance might be quite 
far below that of their peers and expected grade- 
level standards. Second, the different modes of 
instruction available through videos and on¬ 
line formats might be better able to engage stu¬ 
dents (Ma et al. 2014). One example is the em¬ 
phasis on “game-based” learning. Third, the 
use of intelligent tutoring systems that are con¬ 
stantly collecting and analyzing data on stu¬ 
dent performance could encourage the use of 
data to guide instruction more broadly. 


17. For a more detailed discussion, see Ma et al. (2014). 
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Fourth, these technologies might provide 
all students with access to high-quality con¬ 
tent. Like virtual instruction, intelligent tutor¬ 
ing systems rely on centrally developed curric¬ 
ular content and instructional techniques. 
This type of specialization should, in theory, 
allow for more meticulous planning and devel¬ 
opment of material, including quite detailed 
scripts for teachers. As with virtual instruction, 
then, ITS could produce a high-quality class¬ 
room experience—and should produce a rela¬ 
tively uniform one—for students from a broad 
range of backgrounds. 

New technologies offer the possibility of im¬ 
proving instruction in all these ways, but they 
also have important limits. Perhaps most im¬ 
portantly, approaches that completely forgo di¬ 
rect interpersonal interaction are unlikely to 
be able to teach certain skills. Learning is an 
inherently social activity. While an intelligent 
tutoring system might be able to help a stu¬ 
dent master specific math concepts, it may not 
be able to teach students to critically analyze 
a work of literature or debate the ethics of new 
legislation. 

The recent experience of Rocketship, a well- 
known charter school network, illustrates this 
concern. Developed in the Bay Area of Califor¬ 
nia in 2006, Rocketship’s instructional model 
revolves around a blended learning approach 
in which students spend a considerable amount 
of time each day engaged with computer-aided 
learning technologies. The network received 
early praise for its innovative approach to 
learning and, most importantly, for the high 
achievement scores posted by its mostly poor, 
nonwhite student population (Schorr and Mc- 
Griff 2011). In 2012, however, researchers and 
educators raised concerns about graduates 
from Rocketship elementary schools, noting 
that they had good basic skills but were strug¬ 
gling with the critical analysis required in mid¬ 
dle schools (Herold 2014; Guha et al. 2015). 

Does Computer-Aided Instruction Help 
Students Learn? 

There have been hundreds of studies of CAI 
programs over the past twenty-five years, and 
the results are decidedly mixed. A number of 
early syntheses concluded that there are posi¬ 


tive average effects of educational software for 
reading and mathematics (Fletcher-Flinn and 
Gravatt 1995; Kulik 1994), but others did not 
(Kirkpatrick and Cuban 1998). Mark Dynarski 
and his colleagues (2007) conducted experi¬ 
mental evaluations of ten educational technol¬ 
ogy products that had been judged by an ex¬ 
pert review panel to have the greatest potential 
for success. They find that only one of the ten 
has a positive effect on student learning, call¬ 
ing into question many earlier positive find¬ 
ings. 

While recent meta-analyses attempt to 
bring coherence to the large body of existing 
research, no clear consensus has emerged. A 
careful review of these studies and the associ¬ 
ated meta-analyses reveals an interesting pat¬ 
tern. First, studies that use an experimental 
design yield much smaller effects than those 
using quasi-experimental methods (Cheung 
and Slavin 2011, 2013; Ma et al. 2014; Steenber- 
gen-Hu and Cooper 2013). Second, studies us¬ 
ing standardized outcome measures as op¬ 
posed to locally development assessments 
tailored specifically to the technology being 
studied exhibit considerably smaller impacts 
(Koedinger et al. 1997; Kulik and Fletcher 2015; 
Steenbergen-Hu and Cooper 2013). Finally, 
studies with smaller samples generally exhibit 
larger effect sizes (Cheung and Slavin 2011, 
2013; Kulik and Fletcher 2015; Steenbergen-Hu 
and Cooper 2013). Taken together, the most rig¬ 
orous studies (those with large samples, stan¬ 
dardized outcome measures, and an experi¬ 
mental design) yield effect sizes around 0.10, 
which aligns more closely with the findings of 
Dynarski and his colleagues (2007). 

However, these evaluations do suggest im¬ 
portant lessons for developers and practitio¬ 
ners. First, substantial evidence points to the 
importance of implementation barriers. For 
example, researchers who studied Thinking 
Reader found that students used the program 
far less frequently than recommended and 
that, when they did use it, they spent less time 
per book than indicated by program guidelines 
(Drummond et al. 2011). Similarly, in a study 
of the Cognitive Tutor Geometry program, 
John Pane and his colleagues (2010) find that 
teachers had trouble implementing the pro- 
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gram’s instructional practices. For example, 
teachers reported difficulties in implementing 
the collaborative work that required students 
to articulate mathematical thinking, making 
strong connections between computer-based 
activities and classroom instruction, and main¬ 
taining the expected learning pace with many 
students who lacked prior math and reading 
skills. 

Moreover, even successful programs took 
more than one year to show positive effects. 
Pane and his colleagues (2014) conducted a 
large, experimental evaluation of Cognitive Tu¬ 
tor Algebra I in over 140 schools, with 25,000 
students, across the country. Although there 
were no treatment effects in year one, by the 
second year students in the treatment class¬ 
rooms were scoring 0.20 standard deviations 
higher than their peers in control classes. Fol¬ 
lowing a subset of the original Dynarski et al. 
(2007) sample whose teachers continued using 
the programs for a second year, Larissa Cam- 
puzano and her colleagues (2009) find a statis¬ 
tically significant positive effect size of 0.15 on 
student achievement for these students. 

Second, the benefit of ITS depends on the 
context in which it is implemented, including 
the counterfactual instruction that students 
would receive in the absence of the technology. 
In a reanalysis of the Dynarski et al. (2007) 
study, Eric Taylor (2015) finds important het¬ 
erogeneity in the effects across classrooms. He 
shows that the CAI/ITS programs had a posi¬ 
tive impact on students in classrooms with less 
effective teachers and a negative impact on stu¬ 
dents in classrooms with more effective teach¬ 
ers, consistent with the fact that the new tech¬ 
nology was intended, in part, to be a substitute 
for the classroom teacher. Although the aver¬ 
age effect was indistinguishable from zero, the 
effects for some students were not. This result 
highlights the importance of considering not 
only the quality of the new technology but also 
the quality of the education for which it is sub¬ 
stituting. Consistent with this dynamic, evalu¬ 
ations of CAI in developing countries, in set¬ 
tings with fewer resources and arguably less 
skilled teachers, often find positive effects. For 
example, in a large randomized policy evalua¬ 
tion conducted in India, Abhijit Banerjee and 


his colleagues (2005) find strong positive ef¬ 
fects of computer-assisted mathematics pro¬ 
grams on math scores in high-poverty urban 
areas in Mumbai and Vadodara. 

DISCUSSION AND CONCLUSIONS 

The Coleman Report shone light on vast differ¬ 
ences in achievement between poor and non¬ 
poor children and provided evidence that pub¬ 
lic schooling systems were doing little to close 
these achievement gaps. Nonetheless, public 
schools are the primary lever by which govern¬ 
ments seek to affect children’s learning and 
create more equitable opportunities. Their 
lack of effect at the time of the report is not 
necessarily an indictment of their potential. 
Many forces work against schools’ ability to 
close achievement gaps, particularly between 
highly resourced groups and those that are not 
highly resourced. Policy choices and techno¬ 
logical innovations can exacerbate the inequal¬ 
ities that already exist between families, but 
alternatively, they may mitigate or even over¬ 
come those forces. In this paper, we have high¬ 
lighted the potential mechanisms by which 
new technologies may reduce or add to the ex¬ 
isting gaps. As with all prior technologies, this 
potential depends not only on their innovative 
features but also on their implementation. 

The combination of residential segregation 
and, to some extent, local control of schools 
can disadvantage schools serving children 
from lower-income families, reducing or even 
reversing the potential in these cases for a 
public education system to reduce gaps. Even 
within schools, more powerful families can 
advocate for their children to receive greater 
resources, such as more effective teachers, or 
additional supports. When students attend dif¬ 
ferent schools, this potential is far greater, as 
higher-income families can pool resources to 
benefit just their own school, either through 
the tax system or even independently. If the 
teaching jobs are more appealing in these 
schools serving higher-resourced families, as 
they often are, these schools can recruit better 
teachers and school leaders—perhaps the 
most important of all education resources— 
even without additional dollars. 

Unlike teachers, technologies have no pref- 
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erences for the schools in which they work. As 
such, technologies may reduce inequalities in 
resources across schools. The resources avail¬ 
able on the Internet, for example, are equally 
available to all schools with the same Internet 
access, and Internet access costs the same for 
all schools in the same area, regardless of the 
student population served. Technologies can 
reduce differences in peer groups in other ways 
as well. Online courses, for example, can mix 
peers from schools across wide geographic 
areas. Even within schools, technologies can 
have equalizing effects across teachers, in¬ 
creasing the effectiveness of less effective 
teachers by substituting for their areas of weak¬ 
ness. Similarly, technologies that allow teach¬ 
ers to better differentiate instruction may help 
them reach students who are further from the 
average within their classroom, to the aca¬ 
demic benefit of those students. 

The effects of technologies on gaps, how¬ 
ever, may not be all positive. If less capable 
teachers have difficulty making use of the ben¬ 
efits of new technologies—that is, if technolo¬ 
gies and teaching skills are complementary— 
differences across classrooms could increase. 
These differences might add to gaps to the ex¬ 
tent that less capable teachers are concen¬ 
trated in schools with students from less- 
resourced families. Similarly, to be effective 
some technologies may require students to 
have either adult oversight or a set of prior 
skills that will help them make use of the op¬ 
portunities the technologies offer. To the ex¬ 
tent that students from less-resourced families 
have access to fewer supports or have lower 
prior skills, they may not be positioned to reap 
these benefits and inequalities could increase. 

Given the potential for new technologies to 
both reduce and exacerbate inequalities, their 
actual effect is an empirical question. Based 
on the evidence presented here, new technolo¬ 
gies such as virtual courses and ITS, as cur¬ 
rently implemented, are making little headway 
in closing achievement gaps. With respect to 
virtual course-taking, uptake is somewhat 
lower among low-achieving and low-income 
students than among high-achieving and afflu¬ 
ent students, and our new data provide mixed 
evidence on students’ performance in virtual 
versus face-to-face classes. Most importantly, 


virtual courses are not a sufficiently superior 
option that we would expect them to measur¬ 
ably close the achievement gap even if uptake 
among disadvantaged students were higher. 
Current evidence on intelligent tutoring sys¬ 
tems is more internally valid and more san¬ 
guine: high-quality research finds positive (but 
modest) effects, and results seem to be more 
pronounced for students in lower-quality class¬ 
rooms. ITS may be reducing gaps, but only to 
a small degree, owing to both its limited scale 
and its only modest effect on gaps when imple¬ 
mented. 

These results point not to the uselessness 
of new technologies for closing achievement 
gaps, but to the importance of understanding 
how technology interacts with the school and 
home contexts. We leave our analysis of new 
technologies and achievement gaps with four 
conclusions. 

First, technologies have the potential to 
overcome some of the strong forces in U.S. 
public education that lead to inequalities in 
resources across schools. In particular, new 
technologies can bring high-quality curricu¬ 
lum, instruction, and peers to schools that 
have difficulty recruiting these resources ow¬ 
ing to residential segregation, educator prefer¬ 
ence, and differential ability to raise funds. 

Second, technologies can be either substi¬ 
tutes for or complements to resources already 
available in the school. To the extent that tech¬ 
nologies are substitutes, they are inherently 
equalizing. When they are complements, how¬ 
ever, such as when their successful implemen¬ 
tation requires skilled teachers or students 
with strong prior skills, they must be accom¬ 
panied by additional resources if traditionally 
underserved populations are to benefit. 

Third, the range of mechanisms that under¬ 
lie the potential for individual technologies to 
close achievement gaps includes quality, effi¬ 
ciency, differentiation, flexibility, and motiva¬ 
tion. If technologies bring materials of both 
higher and more equal quality to schools, they 
might reduce achievement gaps by reducing 
the differences in access to quality instruction. 
If new technologies reduce extraneous work for 
either teachers or students—such as by reduc¬ 
ing paperwork for teachers or enabling stu¬ 
dents to access the materials they need for 
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their work more quickly—their efficiency can 
benefit students and, if these barriers were 
greater for some groups than others, reduce 
achievement gaps. If new technologies can bet¬ 
ter differentiate instruction to meet the needs 
of students whose performance is further from 
the mean, then they benefit those students 
who are not at the average. As far as closing 
achievement gaps, this differentiation may 
particularly help high-achieving students from 
low-income backgrounds who may not be the 
focus of instruction at schools serving differ¬ 
entially low-performing students. They may 
also benefit particularly low-achieving and 
high-achieving students across all schools. 

New technologies allow for greater flexibility 
that could benefit students who are more likely 
to face shocks at home, such as from health or 
family issues. Technologies make it easier to 
access consistent material when children are 
ill and need to stay home or when families 
move and students need to switch schools. The 
flexibility afforded by new technologies may be 
particularly useful to families with resource 
constraints that affect their residential loca¬ 
tion or health, and this is another way in which 
they may help to reduce the achievement gap. 
Finally, new technologies can either motivate 
or demotivate students. If technologies can 
draw in otherwise disenfranchised students 
through the personalization of material to a 
student’s interest or through gaming technol¬ 
ogy, they can benefit poor students and reduce 
achievement gaps. Alternatively, however, if the 
technologies increase reliance on students’ in¬ 
ternal motivation or require the oversight of 
adults, they may exacerbate achievement gaps. 

Each of these mechanisms—quality, effi¬ 
ciency, differentiation, flexibility, and moti¬ 
vation—can play a role in the impact of new 
technologies on achievement gaps, though 
sometimes not always for the better. 

Fourth, the benefit of new technologies in 
schools for closing achievement gaps may not 
rest primarily in the classroom. The infrastruc¬ 
ture of schools depends on technologies. The 
process of recruiting and hiring educators has 
benefited from online applications and assess¬ 
ments. Predictive analytics that can identify 
students in need of further supports, in com¬ 
bination with greater communication and co¬ 


ordination technologies to link students in 
need with resources inside and outside of 
schools, have great potential to aid those stu¬ 
dents most in need. In considering the poten¬ 
tial of new technologies to reduce achievement 
gaps, it would be a mistake to focus solely on 
computer-aided instruction, virtual courses, or 
other innovations that involved direct interac¬ 
tion with students. 

The evidence to date suggests that technol¬ 
ogies alone cannot eliminate the achievement 
gaps that the Coleman Report so clearly illu¬ 
minated. Political pressures, uneven existing 
resources, and the dependence of even the 
most advanced new approaches on high-quality 
implementation point to the work needed to 
capitalize on the potential of these new tech¬ 
nologies. However, their potential is growing, 
and with it their capacity to counter some of 
the forces that have led to unequal school qual¬ 
ity across communities and kept public schools 
from being the lever that they could be to re¬ 
duce achievement gaps and equalize opportu¬ 
nities. 
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